Agent Simulation of Peer Review: The PR-1 Model

نویسندگان

  • Francisco Grimaldo
  • Mario Paolucci
  • Rosaria Conte
چکیده

Peer review lies at the core of current scientific research. It is composed of a set of social norms, practices and processes that connect the abstract scientific method with the society of people that apply the method. As a social construct, peer review should be understood by building theory-informed models and comparing them with data collection. Both these activities are evolving in the era of automated computation and communication: new modeling tools and large bodies of data become available to the interested scholar. In this paper, starting from abstract principles, we develop and present a model of the peer review process. We also propose a working implementation of a subset of the general model, developed with Jason, a framework that implements the Belief-Desire-Intention (BDI) model for multi agent systems. After running a set of simulations, varying the initial distribution of reviewer skill, we compare the aggregates that our simplified model produces with recent findings, showing how for some parameter choice the model can generate data in qualitative agreement with measures.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Peer Pressure in Smoking and its Impact on Social Welfare; A Study Using Agent-based Modeling and Simulation

Many people die each year due to smoking. Social pressures, such as peer pressure, which are manifested in one's interactions with his/her peers, are from very effective factors in people's tendency to smoke. In this research, it was attempted to study and analyze peer pressure in smoking and its impact on some of the welfare indicators including mortality number due to starvation, wealth avera...

متن کامل

Peer Pressure in Smoking and its Impact on Social Welfare; A Study Using Agent-based Modeling and Simulation

Many people die each year due to smoking. Social pressures, such as peer pressure, which are manifested in one's interactions with his/her peers, are from very effective factors in people's tendency to smoke. In this research, it was attempted to study and analyze peer pressure in smoking and its impact on some of the welfare indicators including mortality number due to starvation, wealth avera...

متن کامل

Opening The Black-Box Of Referee Behaviour. An Agent-Based Model Of Peer Review

This paper investigates the impact of referee behaviour on the quality and efficiency of peer review. We focused especially on the importance of reciprocity motives to ensure cooperation between everyone involved. We modelled peer review as a process based on knowledge asymmetries and subject to evaluation bias. We built various simulation scenarios where we tested interaction conditions and ma...

متن کامل

Disagreement for control of rational cheating in peer review: a simulation

Understanding the peer review process could help research and shed light on mechanisms that underlie crowdsourcing. We present an agent-based model of peer review built on three entities the paper, the scientist and the conference. The model allows us to define a rich model of scoring, evaluating and selecting papers for conferences. Some of the reviewers apply a strategy (called “rational chea...

متن کامل

Innovation Suppression and Clique Evolution in Peer-Review-Based, Competitive Research Funding Systems: An Agent-Based Model

Peer review is ubiquitous in modern science: from the evaluation of publications to the distribution of funding. While there is a long tradition of, and many arguments for, peer review as a beneficial and necessary component of scientific processes, the exponential growth of the research community, the 'publish or perish' pressures and increasing insecurity and competition for research grants h...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2011